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ABSTRACT 

Project Special Elementary Education for the 
Disadvantaged (Project SEED) is a nationwide program in which 
mathematicians and scientists from academia and industry teach 
abstract, conceptually oriented mathematics to full-sized classes of 
elementary school students as a supplement to their regular 
arithmetic classes. A Socratic group-discovery format is used. In its 
implementation in the Dallas (Texas) public schools, SEED was used 
with all levels of children in schools with high percentages of 
minority and low-income children. The 1989-90 evaluation considered 
the program's impact on the achievement of more than 3,000 students 
who had one, two, or three semesters of SEED instruction in grades 
four through six. The achievement these students attained was 
compared, using longitudinal information where possible, with that of 
non-SEED students through the use of Iowa Tests of Basic Skills 
scores and other measures. Impact of one, two, and three semesters 
was apparent, with the minimum at 2.2 months (1 semester, in problem 
solving) and the maximum at 9.0 months (computation, after 3 
semesters). Project SEED students^ were also more likely to enroll in 
advanced mathematics in secondary school. Evaluators recommend that 
the program be expanded to as many students as possible. Thirteen 
tables present evaluation findings, and two appendixes contain an 
additional 13 tables of findings from prior program evaluations. 
(SLD) 
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EXECUTIVE SUMMARY 

EVALUATION OF PROJECT SEED 
1989-90 

Evaluators: William J. Webster and Russell A. Chadbourn 

Project SEED is a nationwide program in which professional mathemati- 
cians and scientists from major universities and research corporations 
teach abstract, conceptually oriented mathematics to full-sized classes of 
elementary school children on a daily basis as an extra-period supplement 
to their regular arithmetic program. The mathematics is presented through 
the use of a Socratic group discovery format in which children discover 
mathematical concepts by answering a sequence of questions posed by the 
SEED instructor. Project SEED believes that only persons who understand 
mathematics in depth possess the versatility to capitalize on the unconven- 
tional and often original insights that children are capable of making ±r. 
an open-ended mathematical dialogue. The initial mathematical topics art 
chosen from high school and college algebra to reinforce and improve the 
students' computational skills and to help equip them for success in 
college-preparatory mathematics courses at the secondary level. Subsequent 
material establishes the mathematical foundation for a number of advanced 
areas of study and progresses into advanced topics in abstract algebra and 
other areas. Project SEED teaches entire regular elementary school classes 
rather than specially selected groups of students. Although SEED was 
originally begun as a program for the educationally disadvantaged (the 
acronjrm SEED stands for Special Elementary Education for the 
Disadvantaged), the project now is implemented with all levels of children 
across the nation. In its DISD Implementation, SEED was used with all 
levels of students and was not intended as a program for a specific group 
of students. The DISD implementation of SEED also continued SEED's 
nationwide practice of using intact classes in the schools in which it is 
implemented. 

EVALUATION QUESTIONS 

1.0 W'oat is the impact of one, two, and three semesters of SEED 
instruction at the A-6 level on mathematics achievement as 
measured by the STEELS and the ITBS ? 

2.0 Is there a cumulative impact of SEED instruction on mathematics 
achievement? 

3.0 Is there a differential grade-retention rate between SEED 
participants and the nonparticipant comparison groups? This 
question will be examined longitudinally. 

4.0 Do former SEED students en/oll in more higher level math classes 
than their non-SEED comparison groups? 

5.0 Do former SEED students withdraw from school less than their 
non-SEED comparison groups? 



6,0 What is the long-term impact of three semesters of SEED 
instruction on mathematics achievement? 

7.0 What reading trends are evident among students who have been 
exposed to SEED? 

All SEED and comparison groups were matched on pretreatment variables ♦ 
The variables were sex, ethnicity, socioeconomic status, grade level, and 
achievement level on the Mathematics Total subtest of the ITBS. Eight 
different samples were used: 

1.0 Students who had one semester of SEED in the South Dallas Learn- 
ing Centers in the fourth grade in 1989-90; two semesters of SEED 
in the South Dallas Learning Centers in the fourth and fifth 
grade in 1988-89 and 1989-90; or, three semesters of SEED in the 
South Dallas Learning Centers in the fourth, fifth, and sixth 
grades in 1987-89, 1988-89, and 1989-90. These students and 
their matched comparison groups were compared on achievement on the 
ITBS and STEELS (Study A), 

2.0 Students who had three semesters of SEED in the South Dallas 
Learning Centers in grades 4-6 in 1984-87, 1985-88, or 1986-89. 
These students and their matched comparison groups are compared 
on achievement on the ITBS both for the years that they were 
exposed to SEED and up to two years later. Course enrollment, 
retention rates, and withdrawal rates were also compared for 
these students (Study B) . 

3.0 Students who had one semester of SEED in 1982-83 or 1983-84 in a 
non-Learning Center enviroranent . These students were compared on 
course enrollment, retention rates, and withdrawal rates (Study 
C). 

All SEED students in groups 1.0 and 2.0 were also Learning Center 
students. This makes straight f onward data interpretation difficult. 
Reading results are analyzed to aid in interpretation of SEED/Center 
mathematics results. 

MAJOR EVALUATION FINDINGS AND RECOMMENDATIONS 

Finding . There is an impact of one, two, and three semesters of SEED 
instruction on mathematics achievement as measured by both the ITBS and 
STEELS. The one semester impact ranges from a low of 2.2 months in Problem 
Solving to a high of 3.9 months in computation. The three semester impact 
ranges from a low of 4.7 months in Problem Solving to a high of 9.0 months 
in Computation. STEELS impact is as high as 13.7 scale points. Tables 2 
and 3 display these data. 

Finding . There is a cumulative impact of SEED instruction on math- 
ematics achievement. The more semesters of SEED that students take, the 
greater the difference between their grade equivalent levels and those of a 
matched comparison group. Groups had up to three semesters of SEED 
instruction. 



ERIC 5^1 



Recommendation > Achievement results suggest that the District should 
expose as many students as is feasible to SEED instruction or, at least, to 
an instructional methodology that is similar to SEED. 

Finding . Former SEED students enroll in significantly more higher 
level mathematics classes than do their matched comparisons. Table 11 
displays relevant data. 

Finding . The student withdrawal rates favor former SEED/Center 
students in thrte of four comparisons, but not significantly so. 

Finding . Two years after the conclusion of their SEED experience, 
former SEED students still achieve significantly higher in mathematics than 
do their comparisons. This is not the case in Reading. 

Finding . There is evidence that the South Dallas Learning Centers are 
having a positive impact on Reading achievement. That impact, however, is 
not nearly as great as the impact in mathematics, nor does the impact last 
as long. Once former Learning Center students have matriculated to middle 
school, there is no longer any difference in reading achievement between 
them and their matched comparisons. Mathematics achievement differences 
are still significant two years after matriculation from a Learning Center. 

For 1990-91, SEED instruction is being expanded to serve students in 
grades 7-8 in a Learning Center environment. This will enable not only an 
analysis of impact of SEED instruction on ITBS and STEELS , but also an 
analysis of impact of SEED instruction on course grades and specific STEELS 
tests since at the middle school level students take separate and distinct 
courses. 

At this point, however, based on four series of longitudinal studies, 
the evaluators would recommend that as many students as feasible, both 
within and outside of Learning Centers, be exposed to SEED instruction or 
to a methodology that is similar to SEED. 
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Table 2 

The Impact Of One And Two Semesters 
Of SEED/Center Instruction 
On Mathematics Achievement 
Spring, 1989-90 



SEED, 1989-90 



Concepts ( ITBS ) 
Problem Solving ( ITBS ) 
Computation ( ITBS ) 
Total (ITBS) 



Spring, 1989 

X S G D 

5.26 1.17 4 .33** 

4.51 1.25 .22** 

5.31 0.96 .39** 

5.03 0.97 .32** 



Spring, 1990 



X 

6.48 
5.60 
6.40 
6.16 



S 

1.51 
1.29 
1.15 
1.18 



G 
5 



D N 
.38** 424 
.17** 
.40** 
.32** 



STEELS Mathematics 



53.5 26.2 8.2 ** 



54.5 27.5 



12.00** 



Reading (ITBS) 



4.36 1.07 



.15* 



5.46 1.15 



.30** 



COMPARISON, 1989-90 



Concepts (ITBS) 
Problem Solving ( ITBS ) 
Computation (ITBS) 
Total (ITBS) 



Spring, 1989 

X S G D 

4.93 1.35 4 - 

4.29 1.35 

4.92 1.03 

4.71 1.12 



Spring, 1990 



X 

6.10 
5.43 
6.00 
5.84 



S 

1.52 
1.40 
1.17 
1.24 



G 

5 



N 

424 



STEELS Mathematics 



45.3 29.2 



42.5 28.8 



Reading (ITBS) 



4.21 1.15 



5.16 1.26 
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Where: 
X ■ mean 

S ■ standard deviation 
G " grade tested 

D ■ difference between experimental (SEED) and comparison groups with the 
difference being tabled with the group that is highest 

* - p < ,05 

** - p f .01 7 
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Table 3 
The Impact Of Two And Three 

Semesters Of SEED/Center 
Instruction On Mathematics 
Achievement . 
Spring, 1988-90 



SEED, 1988-90 



Concepts ( ITBS ) 
Problem Solving ( ITBS ) 
Computation (ITBS) 
Total (ITBS) 



Spring, 1989 



X 

6.86 
5.59 
6.54 
6.33 



S 

1.35 
1.19 
..00 
1.05 



G 
5 



D 

.74** 
.32** 
.53** 
.53** 



Spring, 1990 



X 

7.52 
6.57 
7.65 
7.24 



S 

T.76 
1.55 
1.17 
1.35 



G 



D N 
."58** 190 
.47** 
.90** 
.74** 



STEELS Mathematics 



48.9 28.7 



.93 



53.8 26.0 13.7 ** 



Reading (ITBS) 



5.51 1.32 



,32** 



6.11 1.36 



.24** 



COMPARISON, 1988-90 



Concepts (ITBS) 
Problem Solving (ITBS) 
Computation (ITBS) 
Total (ITBS) 



Spring, 1989 



X 

6.12 
5.27 
6.01 
5.80 



S 

1.43 
1.38 
1.11 
1.16 



G 
5 



Spring, 1990 



X 

6.64 
6.10 
6.75 
6.50 



S 

1.60 
1.65 
1.34 
1.40 



G 
6 



STEELS Mathematics 



47.2 28.5 



40.1 27.6 



Reading (ITBS) 



5.19 1.30 



5.87 1.49 



There was no Spring testing program in 1988. 
Where: 

X « mean grade equivalent 
S * standard deviation 
G « grade 

D ■ difference between experimental (SEED) and comparison groups with the 
difference being tabled with the group that is highest 



* - p < .05 
** - p f .01 
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Table 11 
Number And Percentage Of 
Higher Levi Mathematics 
Courses Enrolled In By Former 
SEED And Comparison Students 



Cohort' 



SEED 



COMPARISON 



N 



M 



K 



HM 



1989(7) 293 589 388 2.01 1.32** 65.9** 

1988(8) 229 919 309 A. 01 1.35** 33.6** 

1987(9) 31A 1870 A23 5.96 1.35 22.6 

1984(10-12) 200 2114 1228 10.57 6.14** 58.1** 

1983(11-G) 197 2143 1390 10.88 7.06** 64.9 



N 



M 



H 



HM 



291 579 238 1.99 0.82 41.1 
236 897 205 3.80 0.87 22.9 
302 1833 413 6.07 1.37 22.5 
215 2132 906 9.92 4.21 42.5 
208 1913 1248 9.2 6.0 65.2 



The 1983 and 1984 cohorts were exposed to one semester of SEED and were not 
enrolled in Learning Centers. 

2 _ . 

The aate represents the last year that students were enrolled in SEED. The 
number in parenthesis represents the grade that the students were in in 
1989-90. 

Where: 

N - the number of students in the cohort 

M " the total number of math courses taken 

H « the number of higher level math courses taken 

A « the average number of semesters of math taken per student 

HM " the average number of semesters of higher level math courses taken per 
student 

P « the percentage of higher level math courses taken 



** m 



p < .01 
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THE EVALUATION OF PROJECT SEED, 
1989-90 

William J. Webster and Russell A. Chadbourn 

PROGRAM DESCRIPTION 

Project SEED is a nationwide program in which professional mathemati- 
cians and scientists from major universities and research corporations 
teach abstract, conceptually oriented mathematics to full-sized classes of 
elementary school children on a daily basis as an extra-period supplement 
to their regular arithmetric program. The mathematics is presented through 
the use of a Socratic group discovery format in which children discover 
mathematical concepts by answering a sequence of questions posed by the 
SEED instructor. Project SEED believes that only persons who understand 
mathematics in depth possess the versatility to capitalize on the unconven- 
tional and often original insights that children are capable of making in 
an open-ended mathematical dialogue. The initial mathematical topics are 
chosen from high school and college algebra to reinforce and improve the 
students' critical thinking and computational skills and to help equip them 
for success in college-preparatory mathematics courses at the secondary 
level. Subsequent material establishes the mathematical foundation for a 
number of advanced areas of study and progresses into advanced topics in 
abstract algebra and other areas. Project SEED teaches entire regular 
elementary school classes rather than specially selected groups of stu- 
dents. Although SEED was originally begun as a program for the education- 
ally disadvantaged (the acronym SEED stands for Special. Elementary 
Education for the Disadvantaged), the project now is implemented with all 
levels of children across the nation. In its DISD implementation, SEED was 
used with all levels of students and was not intended as a program for a 
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specific group of students. The DISD implementation of SEED also continued 
seed's nationwide practice of using intact classes in the schools in which 
it implemented* 

A Typical SEED Class 

Project SEED is a supplementary program which is taught entirely by 
the SEED specialist assigned to a given class* The students in the class 
receive regular baseline instruction in mathematics from their DISD 
teacher. (This will either be a mathematics teacher in a departmentalized 
setting or the classroom teacher in a self-contained setting.) The stu- 
dents then receive a period of SEED instruction , four days a week frcm the 
SEED specialist. The fifth period is an inservice period for the SEED 
specialist which will be discubsed iv more detail later. In this fifth 
period, the students work at the direction of the classroom teacher. This 
work may or may not be related to the material taught in Project SEED at 
the discretion of the teacher, but it usually is not. The teacher is 
always present while SEED is being taught but has no direct instructional 
role in the project. 

Instruction in the SEED program will be considered in two parts, the 
instructional mo.thodology of SEED and the mathematics content of the 
program. SEED uses a group instruction methodology. The class is taught 
using a series of directed questions. Th'». instructor asks questions of 
individuals in the class or of the class as a whole. New material is 
introduced at a slow pace and the majority of classroom time is usually 
spent in working on applications related to material previously encountered 
or in reviewing new and previous work. This stress upon application and 
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review is intended to insure that the students have a solid foundation in 
previously learned material before new material is introduced. 

The SEED specialist uses a number of devices to manage the instruction 
in the classroom. The students are required to respond to most of the 
questions and discussions in the class. The responses are given using hand 
signals unless the students are asked directly to respond verbally. 
Signals are used to indicate agreement and disagreement with the topics of 
discussion and to respond to questions. The purpose of the signals is to 
give the instructor continual feedback about student perceptions of the 
material, to ensure group response which involves most (if not all) of the 
students in the dialogue on the material, and to maintain a degree of order 
in the classroom which could not be achieved using verbal responses. On 
the basis of the observations of SEED classes during the process eval- 
uation, the signals seem to succeed in accomplishing these purposes. 

To help ensure student involvement, each student is called upon 
several times each period to provide answers or comment. In the event a 
student is not participating in the discussions, the SEED instructor will 
use such devices as having the student call upon another student to provide 
an answer or calling upon the student to provide a number for a problem. 
Other devices used to keep student involvement at a high rate include 
having all students participate in group verbal responses to questions, 
having students write answers to questions on their papers and checking all 
or part of the papers immediately, or having all students show the answer 
to a question on their fingers. These methods and a number of others are 
all designed to keep student interest and involvement high, as well as 
to accomplish other instructional objectives. 
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To mitigate problems associated with locus of control in the class- 
room, the SEED instructor moves frequently in the classroom and avoids 
teaching and questioning from the same spot. This also helps keep students 
attentive since, at any moment, the instructor may be asking the next 
question from any part of the room. SEED classes have a higher proportion 
of visitors than usual, and the visitors and the teacher are utilized by 
the instructor. For example, the instructor might ask a visitor to call 
upon a student with his or her hand up to answer a question. In this 
fashion, the students become accustomed to visitors, who are not usually a 
source of interruption in the classroom. 

The primary feature of the instructional system, however, is the set 
of questions asked by the SEED specialist. Almost all of the instruction 
is done through the use of questions. Rarely does the instructor directly 
tell the students anything. This is done, again, to help keep the student 
actively involved in the progress of the class and to avoid having the 
student as a passive recipient of the subject material. The instructor, in 
preparing for the class, thinks through the subject matter to be presented 
and assembles a list of sequenced questions which will be used as the basis 
of the questions asked of the students in class. These questions develop 
the content to be covered in a logical and detailed sequence which is then 
transferred to the classroom and form the heart of the SEED instructional 
process. In general, the SEED classes observed in the process evaluation 
visits exhibited thorough preparation on the part of the instructors ar 
evidenced by the careful sequence of questions used in the instructional 
process. 



SEED Mathematics Content 

The mathematics content observed in the SEED classes consisted primar- 
ily of a thorough preparation in pre-algebra mathematics and beginning 
concepts of abstract algebra, with examples taken from the real number 
system. Some of the topics observed included properties of positive and 
negative numbers, properties of exponents, the additive law of exponents, 
definition and properties of logarithms, use of the distributive law of 
real numbers to prove properties of positive and negative numbers, the 
definition and properties of additive and multiplicative identities, the 
definition of additive inverses, the definition and properties of negative 
exponents, the definition and application of summation and product symbols, 
and an introduction to mathematical series* 

As Indicated by the former General Superintendent, the Dallas Indepen- 
dent School District (DISD) has an underlying goal in instituting the SEED 
program. This goal is to encourage more students to participate in the 
high school algebra sequence and the mathematics sequences following 
algebra. The hope is that participation in the SEED program will give more 
students the motivation to take the course sequences and will equip them 
with the necessary mathematical skills to succeed in these sequences. The 
sample of mathematical skills observed in the SEED classes was relevant to 
this goal. One of the objectives of this study is, within the limitations 
discussed in the Methods section, to determine if this phenomenon can be 
documented. 

SEED as a Classroom Methodology 
During the 1982-83 school year, a number of SEED classroom observa- 
tions were conducted by the District's Research and Evaluation Department. 
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The procedure was informal with no quantifiable criteria, but, rather, it 
was based on impressions of the SEED program contrasted with other instruc- 
tional systems. These impressions are relevant because they further 
describe the treatment as implemented in the District, . 

According to an earlier evaluation report (Mendro, REIS83-019, 1983), 
the first impression produced by SEED was that it contained a highly 
effective instructional system which could be implemented successfully by a 
wide variety of instructors. The organization of the classroom management 
techniques was such that the program generally showed good control of 
instruction in all the classes observed. 

The second positive feature of the SEED program was the inservice 
system. Recall that the SEED instructor teaches four periods and has one 
inservice period per class each week. The purpose of this inservice period 
is to conduct discussions with the classroom teachers about the students 
and the progress of the SEED class, and to observe other SEED instructors 
and provide them with feedback on their implementation of the program. 
This system has two obvious advantages. First, during an inservice period, 
the instructor has a chance to reflect on the instructional components of 
the program and his or her implementation of them; the instructor has a 
chance to see and critique other instructors, which helps keep these skills 
sharp and allows for transmission of effective techniques through direct 
observation; and, finally, the instructor has a chance to participate in 
discussions with other instructors, all of whom share common problems and 
interests. This first advantage of the inservice period generally provides 
the instructor with a chance to keep the instructional techniques fresh and 
alive and gives the project a formal mechanism for transmitting effective 
teaching techniques. The second advantage is that during the non- inservice 



days, the instructor Is liable at any time to have other SEED instructors 
and trainees sit in on a class and provide a required critique of his or 
her teaching that day. This process of continual peer-evaluation is 
perceived as an extremely powerful method of insuring high quality teaching 
throughout the program. 

Thus, the conclusion drawn regarding the instructional quality of SEED 
was that the program had a very good classroom management system. The 
quality of instruction was consistently good across the program and it 
seemed to have an excellent internal procedure for building and maintaining 
that quality, 

PREVIOUS EVALUATION STUDIES 

Three series of studies on the impact of SEED were completed during 
the 1987-88 and 1988-89 school years. All studies focused on the immediate 
and longitudinal impact of SEED instruction on achievement in and attitudes 
toward mathematics. 

Series 1 . The first series of studies examined the impact of one 
semester of SEED instruction on mathematics achievement and attitude. Six 
different treatment groups with their respective comparison groups were 
compared relative to post-SEED achievement trends and mathematics course 
enrollment. The design was set up so that each study was replicated within 
the design. Analyses were performed on two separate and distinct groups of 
fourth, fifth, and sixth graders, each being followed for a period of five 
years. Further replication studies were accomplished by examining the 
immediate Impact of SEED instruction on student achievement in the year 
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that SEED was offered, thus examining the impact of SEED on a group of stu- 
dents that did not exhibit the mortality of the five-year longitudinal 
groups . 

In the case of thir series of studies, SEED students were exposed to 
regular math plus SEED instruction, while comparison students were exposed 
only to regular math. Thus, part of the treatment was additional exposure 
to mathematics (45 minutes). Longitudinal group sizes ranged from 32 to 
87. Short-term group sizes ranged from 245 to 295. Initial groups were 
chosen in 1982-83 and 1983-84. 

The results of this first series of studies suggested strong and 
consistent immediate impact of SEED instruction on mathematics achievement 
as measured by the Concepts, Problem Solving, Computation, and Total 
sections of the Iowa Tests of Basic Skills (ITBS) . These improved scores 
were generally present at least one year after students had been exposed to 
SEED. The results also suggested greater impact of SEED on the achievement 
of lower socioeconomic students. In addition, former SEED students clearly 
took higher percentages of advanced courses than did their matched 
comparisons (Webster and Chadboum, 1988). Relevant achievement data are 
tabled in Appendix A. 

Series 2. The second series of studies examined the achievement 
trends of students who were enrolled in SEED three semesters: one in the 
fourth grade in 1984-85, one in the fifth grade in 1985-86, and one in the 
sixth grade in 1986-87. 

Project SEED has been implemented in three special schools since the 
1984-85 school year. Although the schools have many special programs and 
arrangements, they were primarily designed to raise student achievement 
levels in reading. Classes were self-contained and the homeroom teacher 
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generally taught all subject areas except music and art. We must recognize 
from the outset that the instructional treatment in mathematics represents 
an extra 45-minutes of SEED instruction per day for four days a week. 
Ccnparison students had mathematics instruction by either self-contained 
teachers or mathematics specialists for 60-minutes per day. SEED students 
had instruction by self-contained teachers (non-mathematics specialists) 
plus the instruction by SEE^ instructors. These were the best comparisons 
that were available, since all students in the special schools had SEED. 

As iu the serieis of studies outlined as Study 1 of this investigation, 
CoBiparison Groups were selected from groups of students similar to those 
who received SEED instruction. The same selection criteria were used as 
were used in Study 1 of the investigation except, of course, the Comparison 
Groups matched the characteristics of the Study 2 SEED students. 

Two major questions were examined. First, were the post-SEED instruc- 
tion achievement trends of SEED students different from those of Comparison 
students who were not exposed to SEED? This question was examined sepa- 
rately using the Math Concepts, Math Problem Solving, Math Computation, and 
Math Total scores on the ITBS. 

Second, given that the schools studied were Learning Centers and had 
many special arrangements over other schools, the same type of longitudinal 
analysis was done on reading. The case frr a treatment effect of Project 
SEED would be greatly enhanced if math trends among Center students were 
more positive than reading trends. The Reading subtest of the ITBS wciS 
used for this analysis. In addition, SEED data bases were established so 
that SEED student achievement as well as mathematics course kislection 
versus that of Comparison Students can be analyzed over succeeding >ea'»"s. 




The cohort samples for this part of the stiidy required four years of 
test data. There were 517 SEED and 517 comparison students. The samples 
were one hundred percent Black and Hispanic, and seventy-nine percent on 
free and reduced lunch. Their pre-igSA achievement levels ranged from the 
first to the tenth decile. 

The results of this series of studies suggested an immediate impact of 
SEEP at the fourth grade level on mathematics achievement. This impact 
increased at grade 5 and further accelerated at grade 6. Thus, students 
who entered the fourth grade about even with their peers left the sixth 
grade about one-half year ahead of their peers in Problem Solving and 
almost one year ahead in Concepts. In addition, they were at or above 
grade level in Concepts, Computation, and Total Math scores. 

Both the SEED and comparison samples had Spring, 1984 mean scores of 
3.33 in Reading. During the succeeding three years of instruction, the 
SEED sample advanced to a mean score of 5.98 while the comparison sample 
advanced to a mean score of 5.55. Thus, the SEED sample gained 2.65 grade 
equivaleir. units in reading while the comparison sample gained 2.22 grade 
equivalents in reading. Compare this to a mean gain of 3.18 grade equiva- 
lent units in mathematics for the SEED students versus 2.36 grade equiva- 
lents for the comparison group. Relevant data are tabled in Appendix A. 

Series 3 . The third series of studies replicated the Series 2 studies 
plus added an additional outcome variable, a criterion-referenced test 
entitled the Survey Tests of Essential Elements/Learner Standards (STEELS) . 
This series of studies also examined retention rates, enrollment in higher 
level mathematics classes, withdrawal rates, and long-term impact of SEED. 
Four different samples .were used. These samples included: students who 
had SEED instruction in thp .rning Centers in grades 4-6 in 1985 through 
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1988; students who had SEED instruction In the Learning Centers In grades 
4-6 In 1986 through 1989; follow-up of students who had one semester of 
SEED In 1982-83 or 1983-84 as well as Learning Center students who had 
three semesters of SEED in 1984-87. 

This series of studies on SEED took an indepth look at the impact of 
SEED instruction on mathematics achievement as measured by the ITBS and 
STEELS and on student attitudes toward mathematics as measured by the 
enrollment of students in advanced math courses. Most of the students in 
the SEED group were also Learning Center students, thus introducing an 
intervening variable into the process of interpreting the results. 
Analyses of Learning Center Reading achievement were conducted to provide 
some measure of the impact of the Centers independent of SEED. Early 
non-Center SEED groups were also studied for this purpose. 

Although the primary focus of this series of investigations was to 
examine the impact of Project SEED in the Learning Center environment, part 
of the study focused on non-Learning Center students who had only one 
semester of SEED in the fourth, fifth, or sixth grade. Although the 
achievemen:: impact of this strategy appeared to i^ash out after two years, 
former SEED students still appeared to enroll in more higher level math 
classes, withdraw from the District less, and be retained fewer times than 
did their matched comparison groups. 

The results of this series of studies suggested that SEED instruction 
in the Learning Centers contributed substantially to increased mathematics 
achievement as measured by the I TBS and STEELS , increased enrollment in 
higher level mathematics courses, lowered grade retention and District 
withdrawal rates, a cumulative Impact on mathematics achievement, that is, 
longer exposure to SEED (up to three semesters) appeared to accelerate 
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measured mathematics achievement growth, and, retention of mathematics 
gains for at least two years after exposure to SEED. Relevant data are 
tabled in Appendix B. 

STUDY DESCRIPTION 

The Theoretical Comparison Group 

In the field of practical evaluation it is often impossible to imple- 
ment true experimental designs. The concept of randomly assigning students 
to treatments is repugnant to most educators, particularly in situations 
where it is perceived that one group of randomly assigned students will be 
deliberately withheld from what is often believed to be an effective 
educational treatment. Thus the problem of identifying appropriate compar- 
ison groups is crucial to the interpretability of results. The literature 
is replete with warnings of the threats to the validity of experiments 
involved in comparing non-randomly assigned intact groups. 

All of the comparisons in this series of studies utilize theoretical 
comparison groups. Each student in each of the experimental groups (SEED) 
was systematically matched to a comparison student. These comparison 
students were drawn from many District schools and thus represent many 
different math treatments. The one thing that they all have in common is 
that they have not been exposed to SEED, All matching was done in the year 
prior to exposure to SEED. Variables used in the matching process were: 

1. sex 

2. ethnicity 

3. grade (previous and current year) 

4. socioeconomic status as indicated by free lunch 

5. achievement levels (math total) 
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Design 



Major Evaluation Questions 

The major purpose of this series of studies Is to determine If the 

findings from the previous studies can be replicated. Major evaluation 

questions Include: 

1.0 What is the impact of one, two, and three semesters of SEED 
instruction at the 4-6 level on mathematics achievement as 
measured by the STEELS and the ITBS ? 

2.0 Is there a cumulative Impact of SEED instruction on mathematics 
achievement? 

3.0 Is there a differential grade-retention rate between SEED 

participants and the nonparticipant comparison groups? This 
question will be examined longitudinally? 

4.0 Do former SEED students enroll in more higher level math classes 
than their non-SEED comparison groups? 

5.0 Do former SEED students withdraw from, school less than their 
non-SEED comparison groups? 

6.0 What is the long-term impact of three semesters of SEED instruc- 
tion on mathematics achievement? 

7.0 What reading trends are evident among students who have been 
exposed to SEED? 

All SEED and comparison groups were matched on pretreatment variables. 

The variables are sex, ethnicity, socioeconomic status, grade level, and 

achievement level on the Mathematics Total subtest of the ITBS . Eight 

different samples were used: 

1.0 Students who had one semester of SEED in the South Dallas 

Learning Centers. in the fourth grade in 1989-90; two semesters of 
SEED in the South Dallas Learning Centers in the fourth and fifth 
grade in 1988-89 and 1989-90; or, three semesters of SEED in the 
South Dallas Learning Centers in the fourth, fifth, and sixth 
grades in 1987-89, 1988-89, and 1989-90. These students and 
their matched comparison groups were compared on achievement on 
the ITBS and STEELS (Study A). 

2.0 Students who had three semesters of SEED in the South Dallas 

Learning Centers in grades 4-6 in 1984-87, 1985-88, or 1986-89. 
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These students and their matched comparison groups are compared 
on achievement on the ITBS both for the years that they were 
exposed to SEED and up to two years later • Course enrollment, 
retention rates, and withdrawal rates were also compared for 
these students (Study B) . 

3.0 Students who had one semester of SEED in 1982-83 or 1983-84 in a 
non-Learning Center environment. These students were compared on 
course enrollment, retention rates, and withdrawal rates (Study 
C). 

Thus, three different series of studies were conducted. 

Study A . Study of students who were exposed to one, two, or three semes- 
ters of SEED instruction in the Centers culminating in Spring, 1990, These 
students were compared with their matched comparison group on the ITBS 
Math Total, Concepts, Problem Solving, and Computation Subtests as well as 
the STEELS Mathematics test. Their ITBS Reading subtests were also 
compared as a point of reference for their math results. 

Study B . Longitudinal follow-up of those students who had three semesters 
of SEED In the Centers in 1984-87, 1985-88, or 1986-89. These students 
were compared with their matched comparison groups on the Math Total, 
Concepts, Problem Solving, and Computation subtests of the ITBS . Their 
ITBS Reading scores were also compared to those of their matched comparison 
group as a point of reference for their math results. Retention rates, 
course enrollments, and withdrawal rates were also compared. 

Study C . Report of the follow-up of students who had one semester of SEED 
Instruction in the fourth, fifth, or sixth grades in 1982-83 or 1983-84. 
These students were not associated with Learning Centers. This is a 
follow-up of those students studied in Series 1. SEED students were 
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compared to comparison students on course selection, retention rate, and 
withdrawal rate. Students were either in the 10th, 11th, or 12th grade, or 
graduated. 

Limitations 

Project SEED is currently implemented in the Learning Centers. The 
Learning Centers are special grades A-6 schools that have a number of 
enhancements over regular A-6 schools. It is practically impossible to 
completely eliminatq the effects of the Learning Centers from the effects 
of SEED instruction. However, a number of observations seem appropriate. 

The Learning Centers were established in 1984-85. For the first two 
years of operation, the Learning Centers had staff incentive pay goals 
based on student reading achievement. Mathematics achievement was not part 
of the goal, but was added for the 1986-87 school year. The reader will 
note that all comparisons in this study include longitudinal reading 
comparisons. It was reasoned that if there were major differences between 
reading achievement trends and mathematics achievement trends, and reading 
achievement vas, and still is, the primary goal of the Learning Centers, 
that much of the '^lathematics achievement differences could be attributed to 
Project SEED. 

In 1986-87 the Learning CeuCers implemented a Computer Math Program 
that was to supplement Project SEED. That is. Project SEED was to be 
taught one semester and Computer Math was to be taught one semester. 
According to the Program Manager, 1986-87 was beset with implementation 
problems for the Computer Math Program. Insufficient hardware, no soft- 
ware, and not enough computer specialists were among the problems that 
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plagued the program during most of the 1986-87 school year. Thus, any 
impact that the Computer Math program had would have to be reserved for 
1987-90 and later, 

A final confounding variable relates to teacher training. During the 
summer of 1986, all Center math teachers were trained in SEED strategies by 
Project SEED staff. This training had, of course, varying influence on 
different teachers. 

Method 

Grade equivalent scores, the scale scores for the ITBS, were used for 
all achievement comparisons. Tests for statistical significance were 
computed on all comparisons using tests for the differences between means 
for correlated data. In all cases directional tests were used. 

Characteristics of the samples used in the various studies Included a 
high percentage of Black students (over 95Z), about 80Z students that were 
on free or reduced lunch, and students who scored in every decile of the 
pretreatment achievement distributions. 

RESULTS 

Results are reported in relation to the major evaluation questions 
investigated. 

1.0 What is the impact of one, two, and three semesters of SEED instruc- 
tion at the 4-6 level on mathematics achievement as measured by the 
STEELS and ITBS ? 

Tables 1, 2, and 3 display the impact of one, two, and three semes- 
ters, respectively, of SEED instruction in the Centers on mathematics 
achievement as measured by the ITBS Concepts, Problem Solving, Computation, 
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Table 1 
The Imp/?-t Of One Semester 
Of SEED/ t;ent: fir Instruction 
On Mathematics Achievement 
Spring, 1990 



SEED, 1990 



Concepts ( ITBS ) 
Problem Solving ( ITBS ) 
Computation ( ITBS ) 
Total (ITBS) 



Spring, 1989 



X 

3.91 
3.31 
3.89 
3.70 



S 

1.03 
1.01 
0.90 
0.85 



G 
3 



D 

.02 



Spring, 1990 



X 

4.85 
4.26 
5.17 
4.76 



S 

1.22 
1.19 
1.06 
1.02 



G 
4 



D 



N 



.25** 466 
.21** 
.28** 
.25** 



STEELS Mathematics 



48.0 29.2 



48.2 22.7 



3.8 ** 



Reading (ITBS) 



3.48 1.12 



4.43 1.11 



.22** 



COMPARISON, 1990 



Concepts ( ITBS ) 
Problem Solving ( ITBS ) 
Computation ( ITBS ) 
Total (ITBS) 



Spring, 1989 



X 

3.89 
3.32 
3.90 
3.71 



S G 
1.03 3 
1.05 
0.87 
0.86 



.01 
.01 
.01 



Spring, 1990 



4.60 1.24 

4.05 1.25 

4.89 1.02 

4.51 1.05 



G 
4 



N 

466 



STEELS Mathematics 



Reading (ITBS) 



49.0 30.3 
3.48 1.13 



1.0 



44.4 28.1 
4.21 1.14 



Where : 

X ■ mean grade equivalent 
S ■ standard deviation 
G ■ grade tested 

D - diir^erence between experimental (SEED) and comparison groups with the 
difference being tabled with the group that is highest 
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* - p < .05 
** - p < .01 
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Table 2 

The Impact Of One And Two Semesters 
Of SEED/Center Instruction 
On Mathematics Achievement 
Spring, 1989-90 



SEED, 1989-90 



Concepts ( ITBS ) 
Problem Solving ( ITBS ) 
Computation ( ITBS ) 
Total (ITBS) 



Spring, 1989 



5.26 1.17 

4.51 1.25 

5.31 0.96 

5.03 0.97 



G 
4 



D 

.33** 
.22** 
.39** 
.32** 



Spring, 1990 



X 

6.48 
5.60 
6.40 
6.16 



1.51 
1.29 
1.15 
1.18 



G 
5 



D N 
.38** 424 
.17** 
.40** 
.32** 



STEELS Mathematics 



53.5 26.2 



8.2 ** 



54.5 27.5 



12.00** 



Reading (ITBS) 



4.36 1.07 



,15* 



5.46 1.15 



.30** 



COMPARISON, 1989-90 



Concepts (ITBS) 
Problem Solving (ITBS) 
Computation (ITBS) 
Total (ITBS) 



Spring, 1989 

X S G 

4.93 1.35 4 

4.29 1.35 

4.92 1.03 

4.71 1.12 



Spring, 1990 



X 

6.10 
5.43 
6.00 
5.84 



S G 
1.52 5 
1.40 
1.17 
1.24 



N 

424 



STEELS Mathematics 



Reading (ITBS) 



45.3 29.2 



4.21 1.15 



42.5 28.8 
5.16 1.26 



ERIC 



Where: 
X * mean 

S ■ standard deviation 
G ■ grade tested 



D - difference between experimental (SEED) and comparison groups with the 
difference being tabled with the group that is highest 



* - p < .05 
** « p < .01 
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Table 3 
The Impact Of Two And Three 

Semesters Of SEED/Center 
Instruction On Mathematics 
Achievement . 
Spring, 1988-90 



SEED, 1988-90 



Concepts ( ITBS ) 
Problem Solving ( ITBS ) 
Computation ( ITBS ) 
Total (ITBS) 



Spring, 1989 



X 

6.86 
5.59 
6.54 
6.33 



S 

1.35 
1.19 
1.00 
1.05 



G 
5 



D 

.74** 
.32** 
.53** 
.53** 



Spring, 1990 



X 

7.52 
6.57 
7.65 
1.1k 



S 

1.76 
1.55 
1.17 
1.35 



G 
6 



D N 
.88** 290 
.47** 
.90** 
.74** 



STEELS Mathematics 



48.9 28.7 



.93 



53.8 26.0 



13.7 ** 



Reading (ITBS) 



5.51 1.32 



,32** 



6.11 1.36 



,24** 



COMPARISON, 1988-90 



Concepts (ITBS) 
Problem Solving ( ITBS ) 
Computation ( ITBS ) 
Total (ITBS) 



Spring, 1989 



X 

6.12 
5.27 
6.01 
5.80 



S 

1.43 
1.38 
1.11 
1.16 



G 
5 



Spring, 1990 



X 

6.64 
6. 10 
6.75 
6.50 



S 

1.60 
1.65 
1.34 
1.40 



G 
6 



D 



N 



STEELS Mathematics 



47.2 28.5 



40.1 27.6 



Reading (ITBS) 



5.19 1.30 



5.87 1.49 



ERIC 



There was no Spring testing program in 1988. 
Where : 

X ■ mean grade equivalent 
S - standard deviation 
G grade 

D • difference between experimental (SEED) and comparison groups with the 
difference being tabled with the group that is highest 



* - p < .05 
** - p < .01 
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and Total Mathematics subtests as well as the STEELS Mathematics test. 
Study of Table 1 suggests that, while the two groups were equivalent on the 
Spring, 1989, tests, by Spring, 1990, SEED students were significantly 
better than the comparisons on all subtests of the ITBS and on the STEELS . 
These data also suggest a Center impact on Reading. It should be noted 
that Spring, 1989, was prior to SEED instruction, that instruction 
occurring during the 1989-90 school year and prior to the Spring, 1990, 
testing. 

Table 2 displays the impact of one and two semesters of SEED instruc- 
tion in the Centers. Once again, all comparisons favor the SEED students. 
The two groups were matched, as previously outlined, on 1988 data. The 
data in this table also support the conclusion that the Learning Centers 
are having an impact on Reading as well as on Mathematics. 

Table 3 displays the results of two and three semesters of SEED 
instruction in the Learning Centers. These data tend to support findings 
from previous studies relating to the cumulative impact of more than one 
semester of SEED instruction on mathematics achievement. Spring, 1988, 
scores are not tabled because there was no Spring, 1988, testing program. 
The Spring, 1989, mathematics results represent the impact of two semesters 
of SEED instruction while the Spring, 1990, mathematics results represent 
the effect of three semesters of SEED instruction. On all mathematics 
subtests of the ITBS , the differences between the SEED students and the 
matched comparison groups are largest after three semesters of instruction 
(Table 3, Spring, 1990 Results); larger after two semesters of instruction 
(Table 3, Spring, 1989 Results); and, positive after only one semester of 
SEED instruction (Table 1, Spring, 1990, Results and Table 2, Spring, 1989 
Results). The lone exception to this trend involves the data in Table 2, 
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Spring, 1990, results where the differences between SEED and comparison 
groups are not any larger after two years of instruction than they were 
after one year of instruction. The Reading trend represented in Table 3 is 
more similar to the trend represented in previous studies which is one of 
Center impact that is immediate but not cumulative. 

Results on the STEELS are similar to those reported for the ITBS . 
With the exception of Table 3, Spring, 1989, fifth grade results, the 
STEELS scores are significantly better for SEED students than for their 
matched comparison groups. Comments about the cumulative impact of the 
program on STEELS scores, while tempting to make, are not appropriate 
because of the lack of comparability of STEELS scores across different 
grade levels. Nevertheless, program results on the STEELS are generally 
impressive. 

2.0 Is there a cumulati^J^e impact of SEED instruction on mathematics 
achievement? 

Based on the information provided in Tables 1,2, and 3, there appears 
to be a cumulative impact of SEED instruction on mathematics achievement. 
Tables 4, 5, and 6 further explore this phenomenon. Table 4 tracks stu- 
dents who had SEED in )86-87 through 1988-89. In every case on all 
mathematics subtests, the difference in mathematics scores between SEED and 
comparison students is greater after three semesters of instruction than it 
was after one semester of instruction. This same trend held in Reading.^ 



Spring, 1988 data are not available for any comparisons discussed in 
this report since there was no Spring, 1988 testing program. 
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Table 5 examines SEED and comparison students who had three semesters 
of Instruction during the 1985-86 through 1987-88 school years. in every 
case on all mathematics subtests, the difference between SEED and compari- 
son students is greater after two semesters of instruction than it was 
after one semester. In this case, the Reading scores are uot significantly 
different . 

Table 6 displays ITBS scores for students who were enrolled three 
semesters in SEED during the 1984-85 through 1986-87 school years. Once 
again, in every case on every mathematics subtest the difference between 
SEED and comparison students is greater after two semesters of instruction 
and greatest after three semesters of instruction in SEED. 

Table 7 summarizes all of the studies that have been conducted on SEED 
during the past three years. The numbers in the table are grade-equivalent 
differences between the various SEED groups and their matched comparison 
groups after one, two, or three semesters of treatment. It is important to 
recall that all of these groups started out even, that is, there were no 
practical achievement differences prior to the implementation of SEED. 
Rarely have a series of studies been so consistent. Every entry in Table 7 
favors SEED except the non-Center 1983-84 sixth grade group Problem Solving 
score. One hundred out of one hundred eight compai isons are statistically 
significant at at least the p <^ .05 level. 

Twelve out of twelve possible comparisons support the cumulative 
impact hypothesis on the Math Concepts subtest; eleven out of twelve 
possible comparisons support the cumulative Impact hypothesis on the Math 
Problem Solving subtest; twelve of twelve comparisons support the cumula- 
tive impact hypothesis on the Computation subtest; and, eleven of twelve 
comparisons support this hypothesis on the Math Total subtest. Thus, the 




25 



37 



Table 7 
The Impact Of One, Two, 
And Three Semesters Of SEED/Center 
Instruction On Mathematics 
Achievement As Measured In 
Grade Equivalent Differences Over 

Matched Comparison Groups In 
Three Different Series Of Studies 



Series 
1 



ie(s) 


Semesters In SEED 


C 


PS 


C 


T 


Center Program 


N 


4 


1 


(82 


or 


83) 


.39 


.43 


.65 


.49 


No 


32 


c 


1 


(82 


or 


33) 


. 52 


. 16 


. 28 


. 32 


No 


87 


4 


1 


(83 


or 


84) 


.38 


.22 


.14 


.23 


No 


57 


5 


1 


(83 


or 


84) 


.79 


.33 


.30 


.48 


No 


66 


6 


1 


(83 


or 


84) 


,09 


-.21 


.23 


.04 


No 


72 


4 


1 


(84 


or 


85) 


.15 


.21 


.20 


..'.9 


Yes 


517 


5 


2 


(85 


or 


86) 


.50 


.32 


.41 


.41 


Yes 


517 


6 


3 


(86 


or 


87) 


.93 


.59 


.81 


.78 

" 


Yes 


517 


4 


1 


(84 


or 


85) 


.13 


.10 


. 19 


.14 


Yes 


479 


5 


2 


(85 


or 


86) 


.61 


.29 


.45 


.45 


Yes 


475 


6 


3 


(86 


or 


87) 


.86 


.44 


,69 


.61 


Yes 


475 


A 


1 


(85 


or 


86) 


.34 


.15 


,41 


.30 


Yes 


329 


5 


2 


(86 


or 


87) 


.89 


.41 


.60 


.63 


Yes 


329 


4 


1 


(86 


or 


87) 


.52 


.29 


.52 


.45 


Yes 


545 


6 


3 


(88 


or 


89) 


1.04 


.65 


.82 


.83 


Yes 


545 


4 


1 


(89 


or 


90) 


.25 


.21 


.28 


.25 


Yes 


466 


4 


1 


(88 


or 


89) 


.33 


.22 


.39 


.32 


Yes 


424 


5 


2 


(89 


or 


90) 


.38 


.17 


.40 


.32 


Yes 


424 


5 


2 


(88 


or 


89) 


.74 


.32 


.53 


.53 


Yes 


290 


6 


3 


(89 


or 


90) 


.88 


.47 


.90 


.74 


Yes 


290 


4 


1 


(86 


or 


87) 


.65 


.33 


.68 


.56 


Yes 


294 


6 


3 


(88 


or 


89) 


.90 


.48 


.79 


.72 


Yes 


294 


4 


1 


(85 


or 


86) 


.40 


.17 


.47 


.34 


Yes 


247 


5 


2 


(86 


or 


87) 


.85 


.47 


.61 


.64 


Yes 


247 


4 


1 


(84 


or 


85) 


.15 


.12 


.22 


.17 


Yes 


337 


5 


2 


(85 


or 


86) 


.56 


.30 


.44 


.43 


Yes 


337 


6 


3 


(86 


or 


87) 


.96 


.47 


.76 


.72 


Yes 


337 



Note: All underlined comparisons are significant, p < .05. 
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hypothesis that students gain aiove with increased exposure to SEED (up to 
three semesters) is supported in forty-six cf forty-eight comparisons. 

Table 8 presents similar data in Reading for Center students. Since 
Reading achievement was not a variable in the Series 1 and 2 studies, only 
th-a results of Series 3 and 4 studies are tabled. In the case of Reading, 
there are fifteen of nineteen comparisons that are statistically signifi- 
cant and favor Cen;:er students. Eight of ten comparisons support a cumula- 
tive impact of the Centers on Reading. However, the differences in mean 
grade equivalents between SEED and non-SEED groups are generally much 
greater in Mathematics than they are in Reading. The data support cumula-- 
tive impact of SEED and the Centers in Mathematics much more strongly than 
they support a cumulative impact of the Centers in Reading. 

The case for a cumulative impact of SEED instruction on mathematics 
achievement is strengthened when patterns on the Problem Solving subtest of 
the ITBS are examined. The Problem Solving subtest of the ITBS is the 
subtest that requires more higher order thinking skills than the other 
subtests. Table 9 displays relevant data. 

Study of Table 9 reveals some interesting trends. In four of eight 
cases » two semesters of Center Instruction have more impact on Reading 
achievement than does one semester of SEED instruction plus a semester of 
Center math instruction on mathematics problem solving. This is true in 
only two of six comparisons after four semesters of Reading instruction and 
two semesters of SEED and is not true in a single one of five comparisons 
made after six semesters of Center Reading Instruction versus three 
semesters of SEED. In addition, the aggregate impact of SEED/Center 
instruction on mathematics problem solving is greater with additional 
semesters of exposure. 
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Table 8 
The Impact Of One, 
Two, And Three Semesters 
Of Center Instruction 
On Reading Achievement As Measured 
In Grade Equivalent 
Differences Over Matched 
Comparison Groups In 
Two Different Series Of Studies 



Series Grade(s) Semesters In SEED Reading Center Program _N 



4 


1 


(84 


or 


85) 


.20 


Yes 


479 


5 


2 


(85 


or 


86) 


.24 


Yes 


479 


6 


3 


(86 


or 


87) 


.28 


Yes 


479 


4 


1 


(85 


or 


86) 


.19 


Yes 


329 


5 


2 


(86 


or 


87) 


.09 


Yes 


329 


4 


1 


(86 


or 


87) 


-.09 


Yes 


545 


6 


3 


(88 


or 


89) 


.23 


Yes 


545 


4 


1 


(89 


or 


90) 


.22 


Yes 


466 


4 


1 


(88 


or 


89) 


.15 


Yes 


424 


5 


2 


(89 


or 


90) 


.30 


Yes 


424 


5 


2 


(88 


or 


89) 


.32 


Yes 


290 


6 


3 


(89 


or 


90) 


.24 


Yes 


290 


4 


1 


(86 


or 


87) 


.19 


Yes 


294 


6 


3 


(88 


or 


89) 


.37 


Yes 


294 


4 


1 


(85 


or 


86) 


.11 


Yes 


247 


5 


2 


(86 


or 


87) 


.17 


Yes 


247 


4 


1 


(84 


or 


85) 


.18 


Yes 


337 


5 


2 


(85 


or 


86) 


.22 


Yes 


337 


6 


3 


(86 


or 


87) 


.32 


Yes 


337 



Note: All underlined comparisons are significant, p < .05. 
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Table 9 
The Impact Of One, 
Two, And Three Semesters 
Of SEED/Center Instruction 

On Mathematic Problem 
Solving Compared To Center 
Impact On Reading As Measured In 
Grade Equivalent Differences 
Over Matched Comparison Groups 



Semesters 

Series G rades (s) SEED Center Reading Math Problem Solving N 

3 4 12 .20 .10 479 

5 2 4 .24 .29 475 

6 3 6 .28 .44 475 

4 12 .19 ._15 329 

5 2 4 .09 .41 329 
4 1 2 -.09 .29 545 

6 3 6 .23 .65 545 



4 1 2 .22 .21. 466 

4 12 .15 .22 424 

5 2 4 .30 .n 424 

5 2 4 ,32 .32 290 

6 3 6 .24 .47 290 
4 1 2 .19 .33 294 
6 3 6 .37 .48 294 

4 12 .11 .17 247 

5 2 4 .17 .47 247 

4 2 .18 .j^ 337 

5 2 4 .22 .30 337 

6 3 6 .32 .47 337 



Note: All underlined comparisons are significant, p < .05. 
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3.0 Is there a differential grade retention rate between SEED participants 
and the nonparticipant comparison groups? 



In order to eliminate the effect of the Learning Centers, the 1982-83 
and 1983-84 non-Center SEED students were studied. Retention rates were 
longitudinally tracked. Table 10 shows the number of SEED and comparison 
students who graduated with their class. These students are from the 
original SEED non-Center cohorts from 1982-83 and 1983-84. Study of Table 
10 suggests no difference between the two groups. 

Center students from the 1986-89, 1985-88, and 1984-87 groups have not 
yet had time to graduate, the most advanced students being in the ninth 
grade. The most appropriate test of differential grade retention rates for 
these groups will be graduation rates. These students will continue to be 
tracked. 

4.0 Do former SEED students enroll in more higher level math classes than 
their non-SEED Comparison Group? 

This question was examined from two different perspectives. First, 
the percentage of higher-level math courses enrolled in by SEED students 
and comparison students was analyzed. Second, the average nximber of 
higher-level math courses per student was examined. 

Five different groups of former SEED students were studied. These 
groups include students who had SEED in the Learning Centers and 
matriculated from the sixth grade in 1989, 1988, or 1987. In 1990 these 
students are in either the seventh, eighth, or ninth grades. The other two 
groups include students who had one semester of SEED in 1982-83 or 19t3-84. 
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Table 10 
Percentage Of SEED/Center And 
Comparison Group Students 
Graduating With Their 
Class 



Cohort 

SEED N G % 



Grade 5 


106 


76 


71.7 


1982-83 


Grade 


5 


Cohort 


Grade 6 


136 


76 


55.9 


1982-83 


Grade 


6 


Cohort 


Grade 6 


90 


60 


66.7 


1983-84 


Grade 


6 


Cohort 


TOTAL 


332 


212 


63.9 











Cohort 



COMPARISON N G % 



Grade 5 


106 


73 


68.9 


1982-83 


Grade 


5 


Cohort 


Grade 6 


136 


77 


56.6 


1982-83 


Grade 


6 


Cohort 


Grade 6 


90 


61 


67.8 


1983-84 


Grade 


6 


Cohort 


TOTAL 


332 


211 


63.6 











Where: 

N « number of students In the cohort 

G - number of students graduating with their class 

Z " percentage of students graduating with their class 
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Those students are In the tenths eleventh or twelfth grade or graduated in 
1990. Table 11 displays relevant information about each of the five 
groups. 

Analysis of Table 11 suggests that there is a difference between the 
number of higher-level math courses in which former SEED students enroll as 
compared to their matched comparison group. In the 1989 and 1988 cohorts, 
former SEED students enrolled in significantly more higher level 
mathematics courses and took a significantly higher proportion of those 
courses than did their matched comparison groups. There was no difference 
between the two groups in the 1987 cohort. However, in the 1984 and 1983 
cohorts, former SEED students again enrolled in significantly more higher 
level mathematics classes and, in the 1984 cohort, took a significantly 
higher proportion of higher level math classes. In these two groups, which 
afforded the maximum length of comparison, former SEED students also 
appeared to take more semesters of mathematics than the matched comparison 
group. In the 1983 cohort this phenomenon accounted for the proportion of 
higher level courses taken not being significant since the SEED group, with 
fewer students, took 230 more semesters of mathematics than did the 
comparison group. This amounted to 1.68 more semesters of mathematics per 
student, 1^06 of which were higher level mathematics courses.^ These 
findings support the results of two previous studies. 



Higher level math courses included for the 1989 cohort: Math 7 PH, Math 
7 ADV, Math 8, and Algebra I PH; for the 1988 cohort: Math 7 PH, Math 7 
ADV, Pre-Algebra PH, and Algebra I PH; for the 1987 cohort: Math 8 PH, 
Pre-Algebra PH, Algebra I PH, Algebra II PH, Algebra I, Geometry, 
Geometry PH, and Algebra II; and, for the 1984 and 1983 cohorts: 
Algebra I PH, Algebra II PH, Algebra I, Geometry, Geometry PH, Algebra 
II, Trigonometry H, Elementary Analysis H, Pre-Calculus H, Calculus W/AG 
AP, Number Theory H, Probability and Statistics H, and Math Topics. 
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Table 11 
Number And Percentage Of 
Higher Level Mathematics 
Courses Enrolled In By Former 
SEED And Comparison Students^ 



Cohort' 



SEED 



COMPARISON 



N 



M 



H 



HM 



1989(7) 293 589 388 2.01 1.32** 65.9** 

1988(8) 229 919 309 4.01 1.35** 33.6** 

1987(9) 314 1870 423 5.96 1.35 22.6 

1934(10-12) 200 2114 1228 10.57 6.14** 58.1** 

1983(11-0) 197 2143 1390 10.88 7.06** 64.9 



JN_ JL JL _A. HM P 
291 579 238 1.99 0.82 41.1 
236 897 205 3.80 0.87 22.9 
302 1833 413 6.07 1.37 22.5 
215 2132 906 9.92 4.21 42. 5 
208 1913 1248 9.2 6.0 65.2 



The 1983 and 1984 cohorts were exposed to one semester of SEED and were not 
enrolled in Learning Centers. 

The date represents the last year that students were enrolled in SEED. The 
number in parenthesis represents the grade that the students were in in 
1989-90. 



Where : 



N 
M 
H 
A 
HM 



the number of students in the cohort 

the total number of math courses taken 

the number of higher level math courses taken 

the average number of semesters of math taken per student 

the average number of semesters of higher level math courses taken per 
student 



P « the percentage of higher level math courses taken 



p < .01 
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5.0 Do former SEED students withdraw from school ler.^ rban their non-SEED 
comparison groups? 

Probably not. These daca are extremely inconclusive. The available 
data are withdrawal rates t not dropout rates. There are numerous reasons 
for withdrawals ot sr than dropout. The 1983 cohort withdrawal rate favors 
SEED; the 1984 cohort favors the comparison group; the 1987 cohort favors 
SEED; and, the 1988 cohort also favors SEED. However, the differences are 

sufficiently small and unexplained so as to limit meaningful 

1 

interpretation. Overall, fewer former SEED students have withdrawn from 
the DISD in years subsequent to their SEED experience. 

6.0 What is the long-term impact of three semesters of SEED instruction on 
mathematics achievement? 

Table 12 shows the gap between the SEED and comparison groups in the 
Spring of the last year of SEED instruction and in subsequent years. In 
all cases the SEED Group performed significantly better on all mathematics 
subtests up to two years after exposure to SEED instruction. 

7.0 What reading trends are evident among students who have been exposed 
to SEED? 



150 former SEED students withdrew from the 1983 cohort while 162 former 
Comparison students did. Similar statistics for the other cohorts were: 
1984, 45 SEED, 30 Comparison; 1987, 23 SEED, 35 Comparison; 1988, 18 
SEED, 20 Comparison. 
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Table 12 

The Gap In Grade Equivalents Between 
SEED and Comparison 
Groups On Various ITBS 
Subtests In The Spring Of 
The Last Year Of SEED/Center 
Instruction And In Subsequent 
Years 



Subtests 


Spring, 


1989 


Spring, 1990 






Concepts 


.90** 


6 


.50** 7 






Problem Solving 


.48** 




.19* 






Computation 


.79** 




.41** 






Math Total 


.72** 




.35** 






Reading 


. 37** 




. 13 






Subtests 


Spring, 


1987 


Spring, 1989 


Spring, 


1990 




Gap 


Grade 


Gap Grade 


Gap 


Grad 


Concepts 


.85** 


5 


.47** 7 


.35** 


8 


Problem Solving 


.hi** 




.30** 


.36** 




Computation 


.61** 




.47** 


.47** 




Math Total 


.64** 




.42** 


.39** 




Reading 


.17 




.01 


-.06 




Subtests 


Spring, 


1987 


Spring, 1988 


Spring, 


1989 




Gap 


Grade 


Gap Grade 


Gap 


Grad 


Concepts 


.96** 


6 


7 


.34** 


8 


Problem Solving 


.47** 






.22** 




Computation 


.76** 




- No Spring 


.27** 




Math Total 


.72** 




- Testing Program 


.26** 




Reading 


.32* 






-.03 





This is the last year of data on these students because the systemwide 
testing program is not administered at Grade 9. These students will be 
measured by the TAP in 1991. 



** p < .01 
* p < .05 
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All students studied during this phase of the SEED evaluation were, as 
mentioned previously. Learning Center students. Since the Learning Centers 
have many special arrangements, it is impossible to separate the impact of 
SEED from the overall impact of the Centers. However, one comparison that 
sheds some light on this problem is the leading comparison. SEED does not 
teach reading. The Centers emphasize reading. More Center resources are 
focused on teaching reading than are focused on teaching mathematics, if 
SEED is excluded. Therefore, one should be able to make some statements 
about the impact of SEED depending on the extent of the differences between 
SEED and comparison students in mathematics versus the differences in 
reading. 

Table 13 displays gaps between SEED students and matched comparison 
groups in reading and mathematics. The Series 3 and Series A studies, as 
previously outlined, are studies of students after varying amounts of 
exposure to SEED and the Centers. The three longitudinal studies tabled at 
the bottom of the table follow former SEED and comparison students into the 
seventh and eighth grade. 

Seventeen of nineteen comparisons favor mathematics when SEED and 
comparison groups are compared in the Spring following SEED instruction. 
Three of three follow-up comparisons favor mathematics and SEED. The gap 
between mathematics and reading also tends to get progressively wider with 
additional semesters of SEED/Center instruction. 

Thus, when one considers available data, it appears that Center 
instruction impacts reading achievement but that that impact washes out one 
year after students leave the Learning Centers ♦ SEED/Center instruction 
impacts mathematics achievement pr'-^gressively with additional semesters of 
instruction and is still present two years after instruction. 
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Table 13 

The Immediate And Longitudinal Impact Of 
One, Two, and Three Semesters Of 
Center Instruction On 
Reading And Mathematics Achievement As 
Measured By Grade Equivalent 
Differences Over Matched Comparison 
Groups In Two Different Series Of 
Studies 



Series Grades Semester In Mathematics Gap Reading N Advantage 

SEED 



4 


1 


(84 


or 


85) 


.14 


-.06 


.20 


479 


R 


5 


2 


(85 


or 


86) 


.45 


.21 


.24 


479 


M 


6 


3 


(86 


or 


87) 


.61 


.33 


.28 


479 


M 


4 


1 


(85 


or 


86) 


.30 


,11 


.19 


329 


M 


5 


2 


(86 


or 


87) 


.63 


.54 


.09 


329 


M 


4 


1 


(86 
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SUMMARY AND DISCUSSION 



This study is the fourth in a series of studies that examine the 
impact of Project SEED on mathematics achievement and attitudes. All 
series of studies utilized a theoretical comparison group, that is> groups 
of students matched to SEED students on five characteristics from the 
pretreatment year. Three of the four series of studies were on Learning 
Center students, that is, students enrolled in special schools. The fourth 
series of studies were on non-Learning Center students enrolled in regular 
schools. These studies were conducted over a three-^year period but encom- 
pass SEED and co )arison groups back as far as 1982-83. 

A major intervening variable in the three most recent series of 
studies is the fact that the SEED students were also Learning Center 
students. Since all Learning Center students had Project SEED, and all 
Center teachers had SEED training, there was no opportunity for comparison 
of Learning Center SEED students versus Learning Center non-SEED students. 
However, Reading scores of SEED and comparison group students were analyzed 
to attempt to determine Center impact, and the first series of studies were 
conducted utilizing non-Center SEED students. 

All studies on SEED conducted during the past three years have been 
extremely consistent. Similar results have been replicated through addi- 
tional studies utilizing different groups of students. Major results from 
these studies include: 

1. There is an immediate impact of one semester of SEED instruction 
on mathematics achievement. 

2. There is a cumulative impact of SEED instruction on mathematics 
achievement. The more semesters (up to three) of SEED instruc- 
tion that students take, the greater the difference between their 
grade equivalent levels and those of matched comparison groups. 
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Former SEED students enroll in significantly more higher level 
mathematics classes than do their matched comparison groups. 

Two years after the conclusion of their SEED experience, former 
SEED students still achieve significantly higher in mathematics 
than do their matched comparison groups. 
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APPENDIX A 



Tables From The 1988 
Evaluation Of Project 
SEED 



These studies suggested: 

Ic short-term Impact of SEED Instruction on mathematics achievement, 
particularly for low socioeconomic status students, as measured by 
the ITBS, and 

2. long-term Impact of SEED instruction on attitude toward mathemat- 
ics as measured by enrollment patterns of SEED and comparison 
students in advanced mathematics courses at the middle and early 
high school levels, and 

3. long-term impact on student retention, that is, SEED graduates did 
not appear to be retained in grade as often as their matched 
cohorts , and 

A. a cumulative impact of SEED instruction on mathematics achieve- 
ment, that is, lo.iger exposure to SEED appears to accelerate 
mathematics achievement . The impact of a second semester of SEED 
Instruction appears to be greater than the first, and a third 
semester greater than a second. 
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APPENDIX B 



Tables From the 1989 Evaluation 
Of Project SEED 



These studies suggested: 



!• immediate impact of one semester of SEED instruction on mathemat- 
ics achievement 9 and 

2. a cumulative impact of two and three semesters of SEED instruction 
on mathematics achievement, and 

3. continued high mathematics achievement two years after SEED (we 
only had samples that have progressed through the eighth grades), 
and 

A. long-term impact on attitude toward mathematics as measured by 
enrollment patterns of SEED and Comparison students in advanced 
mathematics courses at the middle and early high school levels. 
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